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In numerical studies of diffusive dynamics, two different action functionals are often used to 
specify the probability distribution of trajectories, one of which requiring the evaluation of the 
second derivative of the potential in addition to the force. Here it is argued that both actions are 
equivalent prescriptions for the purposes of reweighting and sampling trajectories, whereas the most 
probable path is more generally given by the global minimum of the action involving the second 
derivative term. The answer to this apparent paradox lies in the non-differentiable character of 
Brownian paths, as well as in the "entropy" associated with a given trajectory. 
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I. INTRODUCTION 

The present paper is concerned with the probability 
distribution of diffusive trajectories, particularly in dis- 
crete form as suited for numerical computations. In its 
simplest version, the problem is that of specifying the 
probability that a Brownian particle moving according 
to the overdamped Langevin equation^ 



±(t) = ^^ + V2D1l(t) 



c 



(1) 



will follow a particular path from an initial to a final 
position in a given time. Here F{x) — — U'(x) is the force 
acting on the particle, ( is the friction coefficient, D is 
the diffusion constant, and TZ(t) is a random force term 
satisfying the white noise relation (lZ(t)lZ(t')) = 5(t—t'). 
The temperature in energy units, kT, is related to the 
above parameters via the Einstein relation, D = kT/(. 

Unlike their deterministic counterparts, stochastic dif- 
ferential equations such as Eq. ([TJ remain ambiguous un- 
til one specifies the discretization rule for evaluating the 
various time-dependent quantities P Two typical rules are 
the Ito and Stratonovich discretizations, in which F(x(t)) 
is evaluated at the beginning and at the mid-point of the 
time-interval, respectively (see Eq. Q, for example). In 
the continuum limit, it is well known that both choices 
lead to (a) the same Fokker-Planck equation (provided D 
is independent of x; cf. Eq. ( 15 )), 2 and (b) the same path 



integral formula for the propagator, expressed in terms 
of the so-called action functional (cf. Eqs. (fsj)— (J^J) ) . 3 

The above results are consistent with the intuitive ex- 
pectation that the measurable statistical properties of 
a Brownian particle should be insensitive to the partic- 
ular stochastic calculus chosen to describe its motion. 
Nonetheless, an ambiguity of practical character arises 
when deriving a discrete form for the probability distri- 
bution of trajectories, i.e. the discretized action: De- 
pending on the type and the stage at which one carries 
out the discretization, the ensuing action can take on 
different functional forms (cf. Sec. [IT]). In particula r, in 
previous nu merical studies concer ned wit h sampling 
reweighting) 7 * 8 * 9 * 1 -^ and optimizin g 11 * 12 * 13 -* diffusive trajec- 
tories, one typically finds two different expressions for the 



stochastic action, and no consensus seems to exi st as to 
which form should be used in a given application! 9 * 12 * 13 -^ 
It is the purpose of this paper to shed some light on 
this issue. Of course, the scope of this problem goes 
well beyond the prototypical case of a Brownian particle 
moving in a field of force; for example, chemical reactions 
in solution are typically described by effective equations 
of motion that are straightforward multi-dimensional ex- 
tensions of Eq. ([T]). 1 14 A specific example of increasing 
interest in recent years is the microscopic description of 
the mechanisms underlying protein folding, which often 
requires the characterization of diffusive paths connect- 
ing unfolded and folded statesP^^ In these and similar 
cases, it is crucial to understand and resolve the afore- 
mentioned ambiguity. The next section offers a brief in- 
troduction to this problem, followed by specific appli- 
cations to reweighting, sampling, and minimization in 

sec. urn 



II. TWO ACTIONS 

The central quantity of this work is the relative proba- 
bility of observing a given diffusive trajectory connecting 
an initial (xi) to a final (x/) configuration. In the contin- 
uum limit, this probability is directly available from the 
path integral expression for the propagator, P(x^|xjj t)^ 
For the dynamics in Eq. regardless of the discretiza- 
tion adopted, one obtains^ 

P(x f \xi;t)= [ Xt) ^ Vx(s)e- S ^/ 2D , (2) 

Jx(0)=Xi 



where 



S[x(s)} 



AU 



ds 



2D 

T 



F' 



(3) 



is the so-called action functional. Here AU = U(xf) — 
U(xi), and the term involving the formal time derivative 
of x, viz. fdsx 2 , is a shorthand for the free diffusion con- 
tribution to the path-integration measure, cf. Eq. |7) (re- 
call that Brownian trajectories are non-differentiable). 15 
Equation Q shows that each trajectory contributes to 



2 



the propagator with a weight ultimately dictated by its 
action. This will be the object of interest in the remain- 
der of the paper. 



A. Derivation 

Although in the continuum limit the action is given 
unambiguously by the above expression, different discrete 
forms can be obtained depending on how and when one 
discretizes the problem. Here I will follow the (implicit 
or explicit) argument that often appears in the literature 
to justify the use of two particular discrete actions. The 
first arises by performing the discretization at the level 
of Eq. using the Ito rule (which incidentally leads 
to the algorithm traditionally adopted for the numerical 
generation of Brownian trajectories^), namely 



!-n+l 



At 

T 



F n + V2DAt R n 



(4) 



where At is the time step, F n = F(x n ), and R n is a Gaus- 
sian random variable of unit variance. Because the distri- 
bution P(R n ) = e _i? "/ 2 / V2tt is known and the force only 
depends on the previous position x n , the short-time con- 
ditional probability P(x n +i\x n ; At) can be straightfor- 
wardly obtained by changing variables from R n to x n+ i, 
which in this particular case comes with unit Jacobian. 
The corresponding action, which comes from the defini- 
tion 



P{x N \x N -i\ At)--- P( Xl \x ; At) = e s^ -^]/2D 
up to a path-independent factor, is thus given by 

2 



Si[x •••xn] 



a. N-l 



E 



At 



c 



(5) 



(6) 



where Xq — x^ and xjq = Xt. Note that this dictates the 
exact probability of a path generated by Eq. Q for any 
finite At. On the other hand, a direct discretization at 
the level of Eq. ^ gives the action 



S 2 [x ---x N ] 



AU At 



N-l 

E 



At 



2D 

T 



F' 



(7) 



Aside from the formal x 2 term correctly expressed above, 
Eq. (|3| involves ordinary integrals only, and hence is in- 
sensitive to the particular discretization rule adopted in 
Eq. 0. 



B. When are the actions equivalent? 

The two actions derived above are manifestly different; 
in particular, the presence of the derivative of the force 



makes S 2 especially inconvenient for numerical imple- 
mentations, which presumably expla ins why Si is more 
widely adopted in the literatur e! 4 1 5 1 6 1 7 1 (see also Ref.lT8lfor 
a new action functional without this term). Nonetheless, 
the very validity of Si as the action for diffusive prob- 
lems has been questioned by some authors.^ The goal 
of this section is to clarify the (non-)equivalence between 
these two actions. 

To begin the analysis, it is instructive to first consider 
an obvious situation where the actions are not equiva- 
lent, namely, when they arc evaluated in the continuum 
limit over differentiable trajectories. In this case, Eq. © 
becomes 



Si[x(s)} 



AU 



ds 



(8) 



where the cross-term xF/C, was integrated by parts to 
yield the surface term AU/(. Comparing this result with 
the analogous limit of S2, which is repeated here for the 
convenience of the reader (cf. Eq. d3l 



S 2 [x(s)} 



AU 



ds 



2D 

T 



F' 



(9) 



we see that these two expressions differ by a non-trivial 
term whose magnitude is dictated by the ratio -D/f; i.e., 
the actions are generally not equivalent when evaluated 
over differentiable functions (the case where F' is con- 
stant is an exception, e.g. the harmonic potential case 
considered by Onsager and MachlupEl). 

Consider now the case where the actions are evaluated 
over Brownian paths, which are non-differentiable and 
probabilistic in nature. The continuum limit of Eq. |6]) 
then leads to a stochastic integral, which in general does 
not satisfy the usual relations from differentiable calcu- 
lus. Indeed, in the limit of infinitely many intervals, the 
cross term that gave rise to the surface term above be- 
comes an Ito integral, i.e. 

N-l . Xf 

lim \^ (x n+ i — x n )F n = (I) / dxF{x), (10) 

N— >oo * — ' / 

At->0 n=0 Jx ' 

which satisfies the (probabilistic) equality^ (see also Ap- 
pendix) 



(I)/ dxf'(x)=Af-D dsf"(x(s)). (11) 

Jxi JO 

Here D is the diffusion constant associated with the tra- 
jectory x{t), f(x) is an arbitrary differentiable function, 
and Af = f(xf) — f(xi). Note that in the zero-noise 
limit (D — > 0) one recovers the fundamental theorem of 
differentiable calculus; for any finite D, however, this re- 
sult allows one to replace Ito integrals by ordinary time- 
integrals. Consequently, when expressed in terms of ordi- 
nary time-integrals only, the limiting form of Si acquires 
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FIG. 1: Illustrative values of the two discrete actions Si and 
S2, Eqs. (JsJ) and ([7| respectively, evaluated over a typical tra- 
jectory of a Brownian particle moving in a quartic potential 
(noisy curve, see below), as well as over an arbitrary differ- 
entiable function, sin(2-7rt) (smooth curve). Note that the nu- 
meric values of the actions agree to within five significant dig- 
its when evaluated over the Brownian trajectory, while they 
differ by as much as their own magnitude in the case of the 
smooth curve. The actions were evaluated using the quar- 
tic potential U(x) = x 4 /4, and the parameters At — 10 -4 , 
D = 10, and £ = 1. The Brownian path was generated by 
iterating the algorithm in Eq. Q with the same potential and 
parameters. 



a term proportional to the second-derivative of the poten- 
tial in addition to the terms shown in Eq. ([8]), correctly 
recovering Eq. (|9|. This shows the (probabilistic) equiv- 
alence between S± and S2 in the continuum limit when 
evaluated over Brownian trajectories with same diffusion 
constant as that appearing in the definition of S^. 

These observations are summarized in Figures [l] and 

m 



III. APPLICATIONS 

The fact that the relative probability of observing a 
given diffusive path is given by a Boltzmann-like factor 
(cf. Eq. Q) shows that the action and the diffusion 
constant are for trajectories what the energy and the 
temperature are for conformations in the canonical en- 
semble. This analogy has led many authors to trans- 
late equilibrium methods (e.g. sampling, reweighting 
and minimizati on techniques'), to the context of diffu- 
sive trajectories.B' 5 ' ^ 7 ' 8 ' 9 ' 1 " ' 11 ' 1 ^! In this section, I will 
argue that the ensemble of trajectories thus generated (or 
reweighted) is insensitive to the choice between Eq. |6]) 
or Eq. ([7]), while most probable trajectories are more ac- 
curately obtained by minimizing S2 instead of Si. 



FIG. 2: Histograms of the ratio fife [as] /Si [a;] (unnormalized) , 
illustrating the probabilistic equivalence of the actions in the 
continuum limit. Each histogram was evaluated over 100,000 
Brownian trajectories of duration t = 10 generated according 
to Eq. Q for three different At (indicated in the figure), using 



the quartic potential U(x) 

C = l- 



x /4 and the parameters D = 1, 



A. Reweighting 

If one is given an ensemble of diffusive trajectories gen- 
erated under some conditions (e.g. for some potential 
U(x) and diffusion constant D), it is in principle possi- 
ble to "reweight" them so as to obtain a new ensemble 
corresponding to different conditions (e.g. a d iffer ent po- 
tential U*(x), with same diffusion constant)!^ In this 
example, the reweighting factor is given by 



P*[{xi}\x ] 
P[{xi}\x ] 



-AS/2D 



(12) 



where AS = S* [x ■ ■ ■ xn] — S[x ■ ■ ■ xjy] is the action dif- 
ference due to the new potential U*(x), and D is the 
diffusion constant associated with the given ensemble of 
trajectories. The notation P[{cCj}|cco] stands for the prob- 
ability of observing a trajectory {xi} = x\ ■ ■ -xn given 
the initial point xq. The results of the previous section 
immediately indicate that the choice between Si or S2 for 
S is immaterial for this expression: Since the actions are 
equal (in a probabilistic sense) when evaluated over this 
ensemble, the reweighting factor is effectively the same 
whether one uses the former or the latter action. 

Figure [3] presents a simple example of this observation, 
where free trajectories (U (x) = 0) were reweighted so as 
to give an ensemble corresponding to a particle subject 
to a quartic potential U*(x) — £ 4 /4, using the formula 



(x\t)) l 



-AS/2D4 



x\t) 



(13) 
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FIG. 3: The time-dependent moment (x 4 (t)) for a Brownian 
particle starting at the origin and moving on the quartic po- 
tential U*(x) = x 4 /A. The shaded gray curve is the result 
of a direct simulation using Eq. Q. The curves with smaller 
fluctuations about {x 4 (t)} = 1 are the results obtained by 
reweighting 10 fre e (U(x) — 0) Brownian trajectories ac- 
cording to Eq. (13 1, using both Si (black solid curve) and 
The remaining curves correspond to 
"transition 

,l4l5l . 



S2 (red dashed curve) 

a one-ended boundary condition version of the 
path sampling" (TPS) Monte Carlo algorithm,^ 1 with rela- 
tive probability given by Eq. ( 14 1 and action given by Si (blue 
solid curve) and S2 (green dashed curve). The total number 
of trajectories used for the TPS algorithm was 5 x 10 6 . (The 
noise level for the TPS results is high even for such a large 
number of samples because the present Monte Carlo algorithm 
has not been optimized for efficient trajectory sampling). The 
parameters adopted throughout are At = 0.01, £ = 1, and 
D — 1. For these values of D and f, the exact asymptotic 
result (e.g. via the virial theorem) is unity. 



where the specific functional form of AS depends on the 
action adopted, and the particle always starts at the ori- 
gin for both averages. 



B. Sampling 

The case of sampling is subtler. Since now the ac- 
tions generate the ensemble of trajectories itself, one can 
no longer straightforwardly rely on the above argument, 
which assumed the ensemble of trajectories was given. 
Here one is sampling the entire space of trajectories with 
weight dictated by the actionpEl i.e. 



P[{xi}\x ] oc e -S[*o-aw]/2D 



(14) 



where D is the desired diffusion constant. The question 
remains as to whether the ensemble thus generated is 
sensitive to the choice between S\ and S^- 

A short (but not particularly illuminating) answer can 



be given as follows. Since the variable x is Markovian (cf. 
Eq. 0), the statistical properties of its trajectories are 
fully specified by its propagator, P(x\xo;t). The prob- 
lem of equivalence of trajectory ensembles thus reduces 
to that of equivalence of propagators. When one adopts 
Si as the action, one is sampling exactly the same en- 
semble of trajectories as that generated by Eq. Q. In 
the continuum limit, it is known that the propagator cor- 
responding to this Ito-like equation of motion solves the 
Fokker-Planck equation 2 



dP 
~dt 



d_ 

dx 



-P 



D 



d 2 P 

dx 2 



(15) 



But this is precisely the same Fokker-Planck equation 
solved by the path integral in Eqs. ([2|-(|3]), 3 which de- 
fines the propagator of the ensemble of trajectories gen- 
erated by S2 in the continuum limit; i.e. in this limit, 
the propagators corresponding to the ensembles of tra- 
jectories generated by Si and S2 are identical. Thus, by 
the Markovian argument above, the two ensembles are 
statistically equivalent. 

A more constructive proof of equivalence can also be 
given by recalling that, effectively, Si and S2 only differ 
when the trajectories over which they are evaluated have 
a diffusion constant other than that entering the defini- 
tion of S2. Thus, what one needs to show is that the 
probability of sampling a path with diffusion constant 
different from the one specified in Eq. ( 14 1 is vanishingly 
small, whether one uses Si or 5*2; for the remaining tra- 
jectories whose sampling probability is in principle non- 
zero, the actions are effectively equal and hence lead to 
the same relative weight between the trajectories. 

To proceed, notice that both actions contain a Wiener 
(free diffusion) term, and thus - irrespective of the action 
chosen - Eq. ( 14 1 can be factored as 



P[{Xi}\x ] OC Pg}[{Xi}\x ] ■ Pmt[{Xi}\x ], (16) 



where 



EN-1 
71 = 



(17) 



and Pi n t is an action-specific distribution accounting for 
the interaction of the particle with the potential U{x). 
The proof is finished by showing that the presence of the 
modulating factor Pif^ leads to a sharply peaked (i.e. 
zero variance) distribution of diffusion constants about D 
(cf. Appendix), which effectively rules out the sampling 
of trajectories that violate the equivalence between Si 
and S2. 

The above observations are illustrated in Figure [3] 
again for a particle moving in the quartic potential 
U(x) — a; 4 /4. The sampling method adopted is a sim- 
ple extension of the transition path sampling algorithmic 
where only the initial point x(0) — is fixed. The method 
uses a straightforward Monte Carlo procedure, where 
new trajectories are attempted by displacing one of the 
various X{ by a given amount, and accepting or rejecting 



5 



the new trajectory according to the standard Metropolis 
rule^ (recall the analogy between action-diffusivity and 
energy-temperature above). 



U(x) 



C. Minimization and most probable trajectories 

What has been shown so far is that in trajectory space, 
the surfaces defined by Si and S2 are nearly coincident 
over the overwhelming majority of trajectories represen- 
tative of the desired ensemble. Nonetheless, appreciable 
discrepancies between these two surfaces arise when one 
considers trajectories with "wrong" diffusivity; in partic- 
ular, the actions generally lead to entirely different values 
when evaluated over differentiable functions (Sec 



II B I 



As we shall see below, this bears important consequences 
to the study of most probable trajectories. 

Since the probability of observing a given trajectory 
decreases exponentially fast with its action (cf. Eq. (14l), 
the trajectories with greatest statistical weight are those 
for which the action is minimal. For the moment, this will 
be our operational definition of "most probable trajec- 
tory." Consider therefore the problem of minimizing Si 
and S2 in the space of all possible trajectories x - ■ ■ xn- 
It is easy to see that the minima of both actions corre- 
spond to differentiable functions in the continuum limit. 
Indeed, because of the free diffusion contribution com- 
mon to both actions, namely 



Sfreeko " ' ' X n] = 



1 N ~ 1 

-Y 

n=0 



A4 
At 



(18) 



where Ax n = x n+ i — x n , the actions diverge in the con- 
tinuum limit when evaluated over diffusive trajectories, 
for which Ax\ ~ O(At). Differentiable functions, on 
the other hand, yield a finite Sf ree contribution, as in 
this case Ax^ — 0(At 2 ) (i.e. x is finite). Thus, we ar- 
rive at the following situation of conflict concerning most 
probable trajectories: Not only are they highly atypical 
of diffusive processes (insofar as they are differentiable), 
but also their very identity is sensitive to the choice be- 
tween Si and S2 (as these actions are generally different 
for differentiable paths). The story of minimization is 
thus qualitatively different from the case of reweighting 
and sampling. 

The answer to the first conflict is relatively easily set- 
tled, and as we shall see hints at the solution of the 
second. The phenomenon associated with it is not un- 
like that observed in equilibrium sampling studies: Al- 
though the most likely conformations of a given system 
(e.g. atomic clusters, proteins, liquids, etc.) in principle 
correspond to minima in the energy landscape, in prac- 
tice thermal fluctuations will keep the system near to, 
but hardly in the precise location of the minima them- 
selves. Thus, although differentiable paths are virtually 
never observed in diffusive problems, they can provide 
the motif upon which fluctuations - i.e. diffusive trajec- 
tories - emerge. This in turn reveals the importance of 
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FIG. 4: Simple illustration of the entropic role played by the 
curvature near conformational minima. For the same amount 
of thermal energy, say SU, the typical amplitude 8x of confor- 
mational fluctuations near x is much smaller than that near 
x', 5x' (use e.g. SU ~ iU" (x)5x 2 ). Thus, although con- 
formations in the neighborhood of x are energetically favored 
over those near x', the opposite is true when one considers the 
entropy due to the different curvatures, and the final relative 
population of x- and a;'- "like" conformations should embody 
both contributions, e.g. P{x')8x' / P(x)5x = [P(x')/P(x)] x 
[U"(x')/U"(x)]- 1/2 rather than simply P(x')/P{x). 



the neighborhood of the minima in such analyses, which 
was neglected in the above discussion of most probable 
trajectories. 

An illustration of how the nature of such neighbor- 
hoods can affect the definition of most probable trajec- 
tories is given in Fig. [4] for a simple one-dimensional po- 
tential. By analogy, we are thus led to look at relative 
probabilities of the type 



P({x' i }\x )Sx' 1 ---Sx' I 



N 



P({xi}\x ) Sxf ■ Sx N 



-[AS-2DAT,]/2D 



(19) 



where AS = S[x' ■ ■ ■ x N ] — S[xq ■ ■ ■ xn] and similarly for 
the "trajectory entropy" difference AE, where 



H[xi ■ ■ ■ xn) = hr Sxi ■ ■ ■ Sx 



N- 



(20) 



Of course, the definition of E depends on the definition of 
the measure Sx± ■ ■ ■ Sxn, which is not unique; essentially, 
it depends on how far and in what ways one is willing to 
accept points away from a given motif trajectory as mere 
fluctuations about it. Perhaps the simplest definition is 
obtained by looking at the fluctuations of each individ- 
ual x n for a given typical action fluctuation 5S, i.e. by 
inverting the expansion 



5S 



dS 

dx n 



5x„ 



l d 2 S 
2dxl 



5x1 



(21) 



Assuming one is dealing with local minima or points of 
very low gradients in comparison to curvatures, a second- 
order truncation yields the simple measure 



Sxi ■ ■ ■ fejv = 




' 2SS 

s"( XN y 



(22) 



where S"(x n ) is a shorthand for d 2 S[xo ■ ■ -x^/dx^. I 
will now proceed to show that with this simple choice of 
measure in Eq. (191, the second conflict above is elimi- 
nated. 



According to the new relative probability in Eq. (19 1, 
in order to find most likely trajectories the quantity to 
be minimized is not the action alone, but rather the "tra- 
jectory free energy" 



T[x 



■ ■ ■ x N \ 



S[x 



■■■x N ]-2DY,[x x ---x N }. (23) 



Because the actions diverge for diffusive trajectories, any 
minimization process will quickly be restricted to what 
would be differcntiablc trajectories in the continuum 
limit. Let us therefore evaluate the action derivatives 



required by £ (cf. Eqs. (20 1 and ( |22| )) over such trajec- 

0, up to 



tories. From the expressions in Eqs. ([6| and 
terms explicitly of first order in At one gets 

At dSx 



2 dx r , 



At d 2 S 1 
T ~dxl 



- {x r< 



l) 



At 

T 



[(^n+l •^"n)^n F n -(- F n - 



and 



At dS 2 
2 dx n 
At d 2 S 2 
~T~dxl 



l. 



(24) 

(25) 

(26) 
(27) 



A couple of observations are immediately apparent from 
these expressions. First, the gradients of both Si and 
S 2 are of order O(At) for differentiable trajectories [use 
x n+ i - 2x n + x n -i = 0(At 2 ) and (x n+ i - x n )F' n - F n + 
F n -\ = 0(At 2 )], whereas their curvatures diverge as 
C(l/At). Second, to order At, the relative curvatures 
of Si are trajectory-dependent, whereas in the case of S 2 
such curvatures are constant. 

Thanks to the first observation, the definition in 
Eq. (22 1 is valid, and we obtain the trajectory entropy 
corresponding to Si by invoking the result in Eq. ( 25 1 
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• • - x N ] = -^hi 

n=l 
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Y^K + OiNAt 2 ) 



F' n +0{At 2 ) 



(28) 



where use was made of (x n+ i — x n )F^ = O(At), and 
trajectory-independent constants are omitted. An anal- 
ogous computation of the trajectory-dependent compo- 
nents of S2 reveals that 



E 2 [a;i"-a!jv] = G(^VAt 2 ), 



(29) 



which vanishes in the continuum limit; i.e., only Si leads 
to a trajectory-dependent entropy. Therefore, when eval- 
uated over differentiable trajectories in the continuum 
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FIG. 5: The most probable trajectory motifs ( "instantons" ) 
connecting the points x = — 1 and x — +1 in one unit of time 
for the double- well potential Eq. ( |32[ | (see inset), according to 
the minimization of Si (black solid curve) and 5*2 (red dashed 
curve). The parameters are D = £ = 1. Note that without 
the entropic correction, the actions predict rather different 
barrier-crossing times; e.g. for the region —0.3 < x < 0.3 
(shaded area in the U(x) inset) one obtains ti w 0.43 and 
T2 w 0.07 for Si and S2, respectively. 



limit, the quantity to be minimized in the case of Si is 
the "free energy" 

Ti [x(s)] = Si [x(s)] - ^ fdsF', (30) 
s. Jo 

whereas in the case of 5*2 the free energy is simply the 
action itself, i.e. 



?2[x(s)] = S 2 [x(s)}. 



(31) 



Comparing these results with Eqs.(|8]) and j9j, we see that 
when fluctuations are taken into account the quantities to 
be minimized coincide (i.e. T\ = F 2 ), and consequently 
the aforementioned ambiguity disappears. The present 
treatment of most probable trajectories then leads to a 
functional that agrees with more elaborate mathematical 
approaches using induced measures in function spaced 
To illustrate the above observations, consider the one- 
dimensional problem of a Brownian particle moving ac- 
cording to Eq. ([IJ in the double-well potential 



U(x) = 3(x 2 - l) 2 



(32) 



and let us ask what is the most probable trajectory mo- 
tif that takes the particle from the minimum at x = — 1 
to the minimum at x = +1, in one unit of time for 
D = C, = 1 . Figure [5] shows the predictions obtained by 
direct minimization of the actions alone. In agreement 
with our expectation, the actions predict smooth - i.e. 
"differentiable" - paths connecting the end-points, with 
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FIG. 6: Distribution of barrier-crossing times in the barrier 
region —0.3 < x < 0.3 of the double-well potential of Fi e. [5] 
according to the transition path sampling algorithm (TPS/^ 
using both Si (black solid curve) and Sa (red dashed curve) 
for a total trajectory length of t = 1 with At = 0.01 (longer 
trajectory lengths do not change the shape of the instanton, 
and hence yield essentially the same barrier-crossing times 
per instanton). The results from a direct Langevin simu- 
lation using Eq. Q is also shown (shaded gray curve). In 
accordance with the discussion of Sec. |III B| the statistics is 
insensitive to the choice of action. Nonetheless, the predic- 
tions based on the minima of the actions alone (vertical blue 
bars) are quantitatively different (cf. Fig.[5|. The result based 
on 1S2, whose entropic correction is trajectory-independent, is 
in good agreement with the observed maximum in the dis- 
tribution. For comparison, the Kramers time tk ~ 4 (ob- 
tained from the exponential decay of the correlation function 
(x(O)x(t)) ~ e~ t/TK ) was also calculated, and falls well out- 
side the range of the plot. 



the specific shape depending on whether one uses S\ or 
52- In particular, the predicted paths spend rather differ- 
ent times in the barrier region, herein called the "barrier- 
crossing time" (note that this quantity is generally dif- 
ferent from the transition, or Kramers' time, which is 
largely dominated by the residence time in each well). 
In agreement with our discussion above, however, S2 al- 
ready embodies the trajectory entropies, and hence its 
minimum predicts more accurately the overall shape of 
the most probable trajectories, in particular their barrier- 
crossing times (cf . Fig. [6]) . 



IV. CONCLUSIONS 

The present paper was primarily motivated by 
a conspicuous ambiguity in previous numerical 
studies o f diffusive proce sses using path integral 
techniques. ^ ' 7 ' 8 ' 9 ' 10 ' 11 ' 12 ' 13 ] This ambiguity was in- 



troduced in Sec. [TTJ where it was suggested that at 
least two different actions, namely Eqs. ^ and d7j, 
are in principle legitimate prescriptions for the discrete 
representation of the propagator, Eq. It was then 
argued that the actions are indeed equivalent when 
evaluated over diffusive, non-differentiable trajectories 
with the same diffusion constant as that appearing in 
Eq. ([7]), while generally leading to different values when 
evaluated over differentiable paths (Sec. II B I. 



The consequences of these observations to numerical 
simulations were then explored in Sec. |III[ where the 
equivalence of the actions for the purposes of reweighting 
and sampling diffusive paths was shown and numerically 
illustrated, while for problems concerned with the most 
likely "motif" of diffusive trajectories it was argued that 
S2 already contains the relevant entropic corrections con- 
nected with fluctuations about the trajectory motif, and 
hence should be favored over Si in direct minimization 
studies. 

A comforting message in this work i s th at, contrary 
to what has been suggested previously, 121 ^ the second- 
derivative of the potential energy function (cf. Eq. (m|) 
is not always required for the correct description of diffu- 
sive problems (see also Ref . ITH]l ; it is only if one inquires 
about most probable trajectories that this numerically 
inconvenient term plays a role. It is expected that this 
and the other observations above will aid future authors 
in making judicious choices for the discrete action in dif- 
fusive problems. 
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APPENDIX 

This Appendix contains a derivation that illustrates 
two results, namely the validity of the Ito formula 



(Eq. ( 11 1) for a particular choice of f(x), and the sharply 
peaked structure of the distribution of diffusivities about 
D when sampling from fif^. 

For the particular choice f(x) = x 2 /2 in Eq. (Ill, we 
need to show that, 



m a mean-square sense, 



JV-l 

E 

71 = 



\X71-\-X Xji)x n 



Dt = 



(A.33) 



as iV — ► 00, At — ► 0, with t = NAt constant. The 
proof offered below follows closely that of Gardiner^ and 
proceeds by showing that both the fi rst an d the second 
moments of the left-hand-side of Eq. (A.33) are zero for 



a free Brownian trajectory {xi} (an extension to more 
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general cases, e.g. trajectories satisfying Eq. Q, is easily 
performed by keeping track of the leading order terms in 
At only). 



one can write Eq. (A. 35) as 



The trick is to re-express Eq. (A. 33 1 in terms of in- 



((D cB [x ■■■xn]- D)P) a 







(A.38) 



crements Ax n = x n +i — x n , which for free diffusion are 
exactly Gaussian-distributed. A simple algebraic manip- 
ulation of the sum in Eq. (A. 33 1 gives 



N-l 



N-l 



^""^ ( x n+l X n )x n — ^^[ x n+l X n ^ X n] 



ri=0 



n=0 

2 

C 7V — : 



for p — 1,2, where the continuum limit was defined 
above. By itself, this result already shows the sharply 
peaked structure of the distribution of effective diffusiv- 
ities about D. To see where this structure comes from, 
consider the case of free diffusion. Since in this case the 
angle-brackets are nothing but averages with respect to 



N-l 



the density P{^, and since -P^ee depends on the trajec 



(D) 



i 1 V— C , froc , c^v* ou^. 

(A. 34) tory through D cS , namely 



and therefore we need to show that, in the aforemen- 
tioned limit, 



Mr, 



((E n Axl-2Dty) Xo ^0 



(A.35) 



for p = 1,2, where the average subscript means that the 
initial point xq is fixed. The first moment M\ is immedi- 
ately verified, as (Ax^) = 2D At. The second moment 
gives 

M 2 = (T,rAO Xa + (En^A^A^ - (2Dt) 2 , 

(A.36) 

where the cross-term in the quadratic expansion effec- 
tively changed the sign of the last term. Now, for Gaus- 
sian variables, (Ax*)^ = 3 (Ax^) , and since Ax n is 
uncorrelated with Ax rn for n ^ to, we get 

M 2 = 3N(2DAt) 2 + N(N - l)(2DAt) 2 - (2Dt) 2 
= 2(2D) 2 tAt, 

which vanishes in the continuum limit, thus proving 
Eq. ( |A~35| . 

As to the second assertion concerning the role of PifL^ 
in fixing the diffusion constant, if one takes as an effective 
measure of diffusivity of a trajectory the quantity 



T N ^ Ax 2 



D oS [x ■■■xn] 



2t 



(A.37) 



P£2[{*i}\xo] « e -^-f[»G-x*]/ac j (A .39) 
in analogy with canonical averages one can write 

</> Xo = JdD'n xo (D')Pi D J(D')f(D'), (A.40) 

where / is an arbitrary function of D ci {[xq ■ ■ ■ xn], and 

Q xo (£>') = Jd{xi}5{D' -D eS [x ---x N ]) (A.41) 



is the "density of trajectories" with effective diffusion 
constant D'. With this relation in mind, Eq. (A.38 1 



shows that the probability density in effective diffusivity 
space, viz. Q(D') x P^l{D'), is sharply peaked about 
D, as desired. A corollary of this result is that is a 
fast-growing function of the effective diffusion constant 
(indeed, an explicit computation shows that the result is 
analogous to the microcanonical density of states of an 
ideal gas, i.e. Q(D) - D N I 2 for large N). 

From a practical standpoint, the above observation is 
more general than the well known result that the set of 
diffcrcntiablc functions (-D c ff — 0) has measure zero with 

respect to P^^J^as it establishes that the set of all func- 
tions with "wrong" diffusion constant (i.e. D c fi ^ D) is 
also practically precluded from any sampling modulated 

by 42- 
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